Unsloth Dynamic 2.0 Quants

unsloth 's Collections

DeepSeek R1 (All Versions)

Qwen3

Llama 4

Phi-4 (All Versions)

Gemma 3

Unsloth 4-bit Dynamic Quants

Deepseek V3 (All Versions)

Text-to-Speech (TTS) models

Mistral Small 3 (All Versions)

Llama 3.2

Llama 3.3 (All Versions)

Qwen2.5-VL (All Versions)

Qwen QwQ-32B Collection

Vision/multimodal Models

Llama 3.2 Vision

Qwen 2.5 Coder

Llama 3.1 Collection

Qwen 2.5

Load 4bit models 4x faster

4bit Instruct Models

updated 4 days ago

New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & outperforms all leading quantization methods.

Upvote

108

unsloth/DeepSeek-R1-0528-GGUF

Text Generation • Updated about 8 hours ago • 51.2k • 124

Note DeepSeek-R1-0528:
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 2 days ago • 116k • 116
unsloth/Devstral-Small-2505-GGUF

Text2Text Generation • Updated 9 days ago • 113k • 80

Note Mistral-Devstral:
unsloth/Phi-4-reasoning-plus-GGUF

Text Generation • Updated May 1 • 38.7k • 51

Note Phi-4 (reasoning):
unsloth/Phi-4-mini-reasoning-GGUF

Text Generation • Updated May 1 • 25k • 31
unsloth/Phi-4-reasoning-GGUF

Text Generation • Updated May 1 • 6.01k • 7
unsloth/Qwen3-32B-GGUF

Text Generation • Updated 10 days ago • 69k • 63

Note Qwen3:
unsloth/Qwen3-14B-GGUF

Text Generation • Updated 10 days ago • 61.7k • 47
unsloth/Qwen3-8B-GGUF

Text Generation • Updated 10 days ago • 51k • 42
unsloth/Qwen3-30B-A3B-GGUF

Text Generation • Updated 4 days ago • 168k • 193
unsloth/Qwen3-235B-A22B-GGUF

Text Generation • Updated 10 days ago • 45k • 53
unsloth/Qwen3-4B-GGUF

Text Generation • Updated 10 days ago • 52.3k • 42
unsloth/Qwen3-0.6B-GGUF

Text Generation • Updated 10 days ago • 39.2k • 48
unsloth/DeepSeek-R1-GGUF-UD

Text Generation • Updated Apr 28 • 4.9k • 16

Note DeepSeek:
unsloth/DeepSeek-V3-0324-GGUF-UD

Text Generation • Updated Apr 28 • 8.87k • 9
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF

Image-Text-to-Text • Updated 5 days ago • 108k • 87

Note Llama 4:
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF

Image-Text-to-Text • Updated 6 days ago • 43.1k • 23
unsloth/gemma-3-27b-it-GGUF

Image-Text-to-Text • Updated 22 days ago • 48.9k • 126

Note Gemma 3:
unsloth/gemma-3-12b-it-GGUF

Image-Text-to-Text • Updated 22 days ago • 53.2k • 77
unsloth/gemma-3-4b-it-GGUF

Image-Text-to-Text • Updated 22 days ago • 54.2k • 102
unsloth/gemma-3-1b-it-GGUF

Text Generation • Updated 25 days ago • 49k • 38
unsloth/GLM-4-32B-0414-GGUF

Text Generation • Updated May 2 • 17.1k • 32

Note GLM-4:
unsloth/QwQ-32B-GGUF

Text Generation • Updated Apr 27 • 10.5k • 83

Note Qwen QwQ:
unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated 13 days ago • 41.2k • 72

Note Mistral:
unsloth/MAI-DS-R1-GGUF

Text Generation • Updated Apr 27 • 1.81k • 6

Note Microsoft MAI-DS-R1:
unsloth/Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated 25 days ago • 4.73k • 8

Note Llama 3.1:
unsloth/gemma-3-27b-it-qat-GGUF

Image-Text-to-Text • Updated 25 days ago • 14.9k • 8

Note Gemma 3 (QAT):
unsloth/gemma-3-12b-it-qat-GGUF

Image-Text-to-Text • Updated 22 days ago • 13.3k • 13
unsloth/gemma-3-4b-it-qat-GGUF

Image-Text-to-Text • Updated 22 days ago • 10.5k • 8
unsloth/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated 24 days ago • 41.3k • 270

Note DeepSeek-R1-Distill:
unsloth/DeepSeek-R1-Distill-Qwen-1.5B-GGUF

Text Generation • Updated Apr 19 • 26.8k • 108

Upvote

108

Collection guide
Browse collections